Papers with NLP applications
Evaluating zero-shot transfers and multilingual models for dependency parsing and POS tagging within the low-resource language family Tupían (2022.acl-srw)
Copied to clipboard
| Challenge: | Existing studies on NLP applications for low-resource languages have not been done in this area. |
| Approach: | They propose to replicate the transferability of dependency parsers and POS taggers trained on closely related languages within the low-resource language family Tupan. |
| Outcome: | The proposed models replicate the transferability of dependency parsers and POS taggers trained on closely related languages within the low-resource language family Tupan. |
Extracting Topics with Simultaneous Word Co-occurrence and Semantic Correlation Graphs: Neural Topic Modeling for Short Texts (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Empirical results validate that DWGTM can generate more semantically coherent topics than baseline topic models. |
| Approach: | They develop a neural topic model which extracts topics from word co-occurrence graphs . Empirical results validate that DWGTM can generate more semantically coherent topics than baseline topic models. |
| Outcome: | Empirical results show that the proposed model can generate more coherent topics than baseline topic models. |
Pay-Per-Request Deployment of Neural Network Models Using Serverless Architectures (N18-5)
Copied to clipboard
| Challenge: | Using Amazon’s Lambda service for feedforward evaluation and DynamoDB for word embeddings, we demonstrate a serverless deployment of neural networks for NLP applications. |
| Approach: | They propose a pay-per-request pricing model for neural network deployment in NLP applications using Amazon’s Lambda service for feedforward evaluation and DynamoDB for storing word embeddings. |
| Outcome: | The proposed architecture is scalable and inexpensive. |
Deep Learning Approaches to Text Production (N18-6)
Copied to clipboard
| Challenge: | Text production is a key component of many NLP applications . Claire Gardent is based in France and is pursuing research in text production . |
| Approach: | This tutorial will cover the fundamentals and state-of-the-art research on neural models for text production. |
| Outcome: | This tutorial will cover the fundamentals and the state-of-the-art research on neural models for text production. |
Uncertainty Quantification for Large Language Models (2025.acl-tutorials)
Copied to clipboard
| Challenge: | Large language models (LLMs) produce hallucinations, which undermine user trust and reliability. |
| Approach: | This tutorial offers the first systematic introduction to uncertainty quantification (UQ) for LLMs in text generation tasks. |
| Outcome: | The proposed framework provides tools for communicating the reliability of a model answer. |
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing (2022.emnlp-demos)
Copied to clipboard
Chengyu Wang, Minghui Qiu, Taolin Zhang, Tingting Liu, Lei Li, Jianing Wang, Ming Wang, Jun Huang, Wei Lin
| Challenge: | Pre-Trained Models (PTMs) have reshaped the development of natural language processing (NLP) but it is not easy to obtain high-performing PTMs without a large amount of labeled training data and deploy them online with fast inference speed. |
| Approach: | They propose to make it easy to build NLP applications with knowledge-enhanced pre-training and knowledge distillation. |
| Outcome: | EasyNLP supports a comprehensive suite of NLP algorithms and features knowledge-enhanced pre-training, knowledge distillation and few-shot learning functionalities. |
Designing, Evaluating, and Learning from Humans Interacting with NLP Models (2023.emnlp-tutorial)
Copied to clipboard
| Challenge: | This tutorial will cover how to conduct human-in-the-loop usability evaluations to ensure that models are capable of interacting with humans. |
| Approach: | They will provide a systematic overview of key considerations and effective approaches for studying human-NLP model interactions. |
| Outcome: | This tutorial will cover how to conduct human-in-the-loop usability evaluations to ensure that models are capable of interacting with humans. |
The interplay between lexical resources and Natural Language Processing (N18-6)
Copied to clipboard
| Challenge: | linguistic, world and common sense knowledge is an important research area, but processing and storing it in lexical resources is not a straightforward task. |
| Approach: | They propose to use NLP methods to help process of constructing and enriching lexical resources and the use of lexicals for improving NLP applications. |
| Outcome: | The proposed approach aims to speed up and/or ease up the process of resource curation and enrichment. |
Bias and Fairness in Natural Language Processing (D19-2)
Copied to clipboard
| Challenge: | a tutorial will review the history of bias and fairness studies in machine learning and language processing . |
| Approach: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it presents recent community effort to quantify and mitigat bias in natural language processing models . |
| Outcome: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it aims to quantify and mitigate bias in natural language processing models for a wide spectrum of tasks . |
Discreteness in Neural Natural Language Processing (D19-2)
Copied to clipboard
| Challenge: | This tutorial provides a comprehensive guide to the process of discreteness in neural NLP. |
| Approach: | This tutorial provides a comprehensive guide to the process of discreteness in neural NLP. |
| Outcome: | This tutorial explains the process of discreteness in neural NLP. |
Language Learning and Processing in People and Machines (N19-5)
Copied to clipboard
| Challenge: | This tutorial introduces different stages of language acquisition and their parallel problems in NLP. |
| Approach: | This tutorial introduces different stages of language acquisition and their parallel problems in NLP. |
| Outcome: | This tutorial introduces different stages of language acquisition and their parallel problems in NLP. |
JUDGEBERT: Assessing Legal Meaning Preservation Between Sentences (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation metrics for text simplification focus on only one dimension: fluency, simplicity and meaning preservation. |
| Approach: | They introduce a dataset to assess legal meaning preservation between two legal texts . they also introduce sanity checks for two identical sentences . |
| Outcome: | The proposed metric shows superior correlation with human judgment compared to existing metrics. |
Contrastive Data and Learning for Natural Language Processing (2022.naacl-tutorials)
Copied to clipboard
| Challenge: | Current NLP models heavily rely on effective representation learning algorithms. |
| Approach: | This tutorial introduces contrastive learning and provides an introduction to the techniques. |
| Outcome: | This tutorial provides an introduction to the fundamentals of contrastive learning approaches and the theory behind them. |
Semantic Specialization of Distributional Word Vectors (D19-2)
Copied to clipboard
| Challenge: | Distributional word vectors conflate various paradigmatic and syntagmatic lexico-semantic relations. |
| Approach: | This tutorial provides an overview of specialization methods for distributional word vectors . a common solution is to include external lexico-semantic knowledge in a reshaped vector space . |
| Outcome: | This paper provides an overview of specialization methods for distributional word vectors . the most recent developments include a new method for asymmetric relations in Euclidean . |
Essentia: Mining Domain-specific Paraphrases with Word-Alignment Graphs (D19-53)
Copied to clipboard
| Challenge: | Existing methods for mining general-purpose paraphrases are often based on statistical methods, but domain-specific corpora are too small to fit statistical methods. |
| Approach: | They propose a method to mine paraphrases from a small set of sentences that roughly share the same topic or intent. |
| Outcome: | The proposed method obtains high quality paraphrases as evaluated by crowd workers. |
Natural Language Processing for Multilingual Task-Oriented Dialogue (2022.acl-tutorials)
Copied to clipboard
| Challenge: | a tutorial will examine the challenges and gaps in multilingual ToD research . multilingual systems are difficult to build, and are limited to English and other languages . |
| Approach: | This tutorial will discuss the importance of multilingual task-oriented dialogue systems . it will provide an overview of current research gaps, challenges and initiatives related to multilingual ToD systems - with a particular focus on their connections to current research and challenges in multilingual and low-resource NLP. |
| Outcome: | This tutorial will provide an overview of current research gaps, challenges and initiatives related to multilingual ToD systems. |
Demonstrating Par4Sem - A Semantic Writing Aid with Adaptive Paraphrasing (D18-2)
Copied to clipboard
| Challenge: | a new tool for semantic writing aids collects training examples from usage data. |
| Approach: | They propose a semantic writing aid tool based on adaptive paraphrasing that integrates into a real word application to collect training examples from usage data. |
| Outcome: | The proposed tool is integrated into a real word application to collect training examples from usage data. |
GLiNER2: Schema-Driven Multi-Task Learning for Structured Information Extraction (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Existing solutions for information extraction (IE) require specialized models for different tasks or require expensive large language models. |
| Approach: | They propose a framework that enhances the original GLiNER architecture to support named entity recognition, text classification, and hierarchical structured data extraction within a single efficient model. |
| Outcome: | The proposed framework improves performance across diverse IE tasks and accessibility compared to LLM-based alternatives. |
Identification of Alias Links among Participants in Narratives (P18-2)
Copied to clipboard
Sangameshwar Patil, Sachin Pawar, Swapnil Hingmire, Girish Palshikar, Vasudeva Varma, Pushpak Bhattacharyya
| Challenge: | Identifying distinct and independent participants in a narrative is crucial for many NLP applications. |
| Approach: | They propose an approach based on linguistic knowledge for identification of aliases mentioned using proper nouns, pronouns or noun phrases with common noun headword. |
| Outcome: | The proposed approach performs better than the state-of-the-art approach on four diverse history narratives of varying complexity. |
Transformer-GCRF: Recovering Chinese Dropped Pronouns with General Conditional Random Fields (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to recover dropped pronouns ignore the dependencies between pronounes in neighboring utterances. |
| Approach: | They propose a framework that combines Transformer network and General Conditional Random Fields to model the dependencies between pronouns in neighboring utterances. |
| Outcome: | The proposed framework outperforms state-of-the-art models on three Chinese conversation datasets showing that it captures the dependencies between pronouns in neighboring utterances. |
BENTO: A Visual Platform for Building Clinical NLP Pipelines Based on CodaLab (2020.acl-demos)
Copied to clipboard
| Challenge: | CodaLab has limited support for creating reusable tools that can be easily applied to different datasets and composed into pipelines. |
| Approach: | They propose a workflow management platform with a graphic user interface built on top of CodaLab to facilitate the process of building clinical NLP pipelines. |
| Outcome: | The proposed workflow management platform, BENTO, is designed for clinical NLP tasks and can be easily used by researchers and developers. |
COMMA: Modeling Relationship among Motivations, Emotions and Actions in Language-based Human Activities (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for modeling motivations, emotions and actions in language-based human activities have been limited. |
| Approach: | They propose to model motivations, emotions and actions in language-based human activities using a dataset called Story Commonsense. |
| Outcome: | The proposed model can better reveal the essential relationship between motivations, emotions and actions than existing methods. |
The Mediomatix Corpus: Parallel Data for Romansh Language Varieties via Comparable Schoolbooks (2026.findings-eacl)
Copied to clipboard
| Challenge: | a small-scale human evaluation confirms that the segments are highly parallel, making the dataset suitable for NLP applications. |
| Approach: | They present a first parallel corpus of Romansh idioms from 291 schoolbooks . they use automatic alignment methods to extract 207k multi-parallel segments from the books . |
| Outcome: | The proposed corpus is based on 291 schoolbook volumes, which are comparable in content for the five idioms. |
Recognizing UMLS Semantic Types with Deep Learning (D19-62)
Copied to clipboard
Isar Nejadgholi, Kathleen C. Fraser, Berry De Bruijn, Muqun Li, Astha LaPlante, Khaldoun Zine El Abidine
| Challenge: | Entity recognition is a critical first step to a number of clinical NLP applications, such as entity linking and relation extraction. |
| Approach: | They propose to use general and domain-specific information to combine general and specific information to create a new entity recognition method. |
| Outcome: | The proposed method produces a state-of-the-art result on a newly released dataset, MedMentions. |
Providing Semantic Knowledge to a Set of Pictograms for People with Disabilities: a Set of Links between WordNet and Arasaac: Arasaac-WN (2020.lrec-1)
Copied to clipboard
Didier Schwab, Pauline Trial, Céline Vaschalde, Loïc Vial, Emmanuelle Esperanca-Rodier, Benjamin Lecouteux
| Challenge: | Pictograms are a tool that is increasingly used by people with cognitive or communication disabilities. |
| Approach: | They propose a database that links WordNet and Arasaac to link pictograms to semantic knowledge. |
| Outcome: | The proposed database links pictograms with WordNet and Arasaac to create language-independent prototypes. |
Automatic Spelling Correction for Resource-Scarce Languages using Deep Learning (P18-3)
Copied to clipboard
| Challenge: | Indic languages are resource-scarce and do not have such parallel data due to low volume of queries. |
| Approach: | They propose a sequence-to-sequence deep learning model which trains end-to end for Indic languages, Hindi and Telugu. |
| Outcome: | The proposed model is competitive with existing spell checking and correction techniques for Indic languages. |
What about “em”? How Commercial Machine Translation Fails to Handle (Neo-)Pronouns (2023.acl-long)
Copied to clipboard
| Challenge: | Wrong pronoun translations can discriminate against marginalized groups, e.g., non-binary individuals. |
| Approach: | They compare 3rd-person pronoun translations to five other languages . they propose to address gender exclusivity in future research . |
| Outcome: | The proposed method compares translations of gendered vs. gender-neutral pronouns from english to five other languages and vice versa. |
PyFoma: a Python finite-state compiler module (2024.acl-demos)
Copied to clipboard
| Challenge: | Finite-state models can be used to constrain output of neural networks to prevent text generation that fails to adhere to a specific format. |
| Approach: | They propose to build finite-state automata from regular expressions, string rewriting rules, right-linear grammars, or low-level state/transition manipulation. |
| Outcome: | The module is designed for teaching finite-state models and finite models. |
Graph-to-Sequence Learning using Gated Graph Neural Networks (P18-1)
Copied to clipboard
| Challenge: | Existing approaches to graph-to-sequence learning ignore the full graph structure, discarding key information. |
| Approach: | They propose a graph-to-sequence learning model that encodes the full graph structure and an input transformation that allows nodes and edges to have their own hidden representations. |
| Outcome: | The proposed model outperforms baselines in generation from AMR graphs and syntax-based neural machine translation while retaining the full graph structure. |
Sentence Identification with BOS and EOS Label Combinations (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for preprocessing sentences only use the end of the sentence (EOS) however, real-world texts often contain non-sentential units (NSUs) such as metadata, sentence fragments, etc. |
| Approach: | They propose a task of sentence identification where the goal is to identify SUs while excluding NSUs in a given text. |
| Outcome: | The proposed method outperforms baselines which only use EOS labels on the sentence identification task. |
PUCP-Metrix: An Open-source and Comprehensive Toolkit for Linguistic Analysis of Spanish Texts (2026.eacl-demo)
Copied to clipboard
| Challenge: | Existing tools for linguistic analysis of Spanish texts lack linguistic features for interpretability and tasks that involve style, structure, and readability. |
| Approach: | They propose to use PUCP-Metrix to analyze Spanish texts in a language repository. |
| Outcome: | The proposed toolkit performs better on automated readability assessments and machine-generated text detection tasks than existing repositories and strong neural baselines. |
Par4Sim – Adaptive Paraphrasing for Text Simplification (C18-1)
Copied to clipboard
| Challenge: | a new challenge is learning from a real-world data stream and continuously updating the model without explicit supervision. |
| Approach: | They develop an adaptive learning system for text simplification which improves the underlying ranking model from usage data. |
| Outcome: | The proposed system improves the learning-to-rank model from usage data over time. |
Heterogeneous Graph Neural Networks to Predict What Happen Next (2020.coling-main)
Copied to clipboard
| Challenge: | Existing work on event representation cannot capture discontinuous event segments . Existing models cannot represent heterogeneous relations and discontinuous events . |
| Approach: | They propose a heterogeneous-event graph network to model missing events . they employ each unique word and individual event as nodes in the graph . |
| Outcome: | The proposed model outperforms baseline models on one-step and multi-step inference tasks. |
Beyond Good Intentions: Reporting the Research Landscape of NLP for Social Good (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in natural language processing (NLP) have created a vast number of applications that are aimed at social good applications. |
| Approach: | They propose a dataset with three tasks that can help identify NLP4SG papers and characterize the NLP landscape by: (1) identifying the papers that address a social problem, (2) mapping them to the corresponding UN Sustainable Development Goals, and (3) identifying their methods. |
| Outcome: | The proposed dataset can help identify NLP4SG papers and characterize the NLP landscape by: (1) identifying the papers that address a social problem, (2) mapping them to the corresponding UN Sustainable Development Goals (SDGs), and (3) identifying their methods. |
Cross-lingual Knowledge Graph Alignment via Graph Convolutional Networks (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to align multilingual knowledge graphs with counterparts in different languages are not effective. |
| Approach: | They propose a novel approach for cross-lingual KG alignment via graph convolutional networks . they train GCNs to embed entities of each language into a unified vector space . |
| Outcome: | The proposed approach gets the best performance on real multilingual KGs compared with other embedding-based approaches. |
Practical Takes on Federated Learning with Pretrained Language Models (2023.findings-eacl)
Copied to clipboard
| Challenge: | federated learning with pretrained language models for language tasks entails data privacy constraints when learning from diverse data domains. |
| Approach: | They propose to use pretrained language models to learn from diverse data domains . they elaborate hypotheses over the components in federated NLP architectures based on three tasks . |
| Outcome: | The proposed model can generalize by adapting to the different domains. |
Olive Oil is Made of Olives, Baby Oil is Made for Babies: Interpreting Noun Compounds Using Paraphrases in a Neural Model (N18-2)
Copied to clipboard
| Challenge: | Recent work suggests that success stems from memorizing single prototypical words for each relation. |
| Approach: | They propose a neural paraphrasing approach that maps NCs to paraphrases that express the relation between constituent words. |
| Outcome: | The proposed method performs better when memorization is not possible. |
Internal and External Impacts of Natural Language Processing Papers (2025.acl-short)
Copied to clipboard
| Challenge: | a new study examines the impact of NLP research published in top-tier conferences from 1979 to 2024 . language modeling has the widest internal and external influence, while linguistic foundations have lower impacts . |
| Approach: | They analyze citations from research articles and external sources to determine how NLP topics are consumed internally and externally. |
| Outcome: | The findings show that language modeling has the widest internal and external influence . ethics, bias, and fairness show significant attention in policy documents with fewer academic citations . |
Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for supervised meta-learning require many training tasks to generalize . cloze-style objectives can be used to generate a large, rich, meta-training task distribution from unlabeled text. |
| Approach: | They propose a self-supervised approach to generate a large, rich, meta-learning task distribution from unlabeled text. |
| Outcome: | The proposed approach generates a large, rich, meta-learning task distribution from unlabeled text. |
Neural Cross-Lingual Relation Extraction Based on Bilingual Word Embedding Mapping (D19-1)
Copied to clipboard
| Challenge: | Relation extraction (RE) is an important information extraction task that seeks to detect and classify semantic relationships between entities. |
| Approach: | They propose a bilingual word embedding mapping approach for cross-lingual RE model transfer . they use a small bilingual dictionary with only 1K word pairs to embed word pairs . |
| Outcome: | The proposed approach achieves very good performance on target and target languages . it uses bilingual word embedding mapping to transfer a source-language model . |
Can Large Language Models Advance Crosswalks? The Case of Danish Occupation Codes (2025.naacl-srw)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are used to map classification systems to each other . however, their use is labor-intensive and requires domain expertise . |
| Approach: | They propose a prompt-based framework where LLMs perform similarity assessments between classification codes and identify final mappings through a guided decision process. |
| Outcome: | The proposed framework shows that LLMs perform better than the embedding-based framework in creating crosswalks. |
Code-Switched Language Identification is Harder Than You Think (2024.eacl-long)
Copied to clipboard
| Challenge: | Code switching (CS) is a common phenomenon in written and spoken communication, but is handled poorly by many NLP applications. |
| Approach: | They propose to use CS language identification for corpus building to make it more realistic by scaling it to more languages and considering models with simpler architectures for faster inference. |
| Outcome: | The proposed system is based on a sentence-level multi-label tagging problem and provides recommendations for future work. |
True Few-Shot Learning with Prompts—A Real-World Perspective (2022.tacl-1)
Copied to clipboard
| Challenge: | Recent work has cast doubt on the effectiveness of prompt-based approaches at few-shot learning in a “true” few- shot setting. |
| Approach: | They propose a method that combines textual instructions with example-based finetuning to give prompt-based learning a powerful method for few-shot text classification. |
| Outcome: | The proposed method performs well in a few-shot setting without a dev set and is able to handle multiple prompts. |
A Question of Style: A Dataset for Analyzing Formality on Different Levels (2023.findings-eacl)
Copied to clipboard
| Challenge: | Using machine learning, we can produce contextually appropriate language. |
| Approach: | They present a dataset of German sentence-level formality assessed on a continuous informal-formal scale. |
| Outcome: | The proposed dataset compares sentences from a wide range of genres assessed on a continuous informal-formal scale. |
LongEmbed: Extending Embedding Models for Long Context Retrieval (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing embedding models support only 512 input tokens, hindering their application in scenarios requiring long inputs. |
| Approach: | They evaluate the performance of existing embedding models by using a new benchmark and a training-free context window extension strategy. |
| Outcome: | The proposed model extends the input window of existing models by several folds. |
Speed Without Sacrifice: Fine-Tuning Language Models with Medusa and Knowledge Distillation in Travel Applications (2025.acl-industry)
Copied to clipboard
Daniel Zagyva, Emmanouil Stergiadis, Laurens Van Der Maas, Aleksandra Dokic, Eran Fainman, Ilya Gusev, Moran Beladev
| Challenge: | Rapid growth of digital applications has intensified the demand for real-time natural language processing (NLP) capabilities. |
| Approach: | They propose a framework that combines Medusa and knowledge distillation to achieve compounded benefits in both model size and inference speed. |
| Outcome: | The proposed framework reduces inference latency by 10-20x while maintaining the student model’s performance quality. |
Interactive Text Ranking with Bayesian Optimization: A Case Study on Community QA and Summarization (2020.tacl-1)
Copied to clipboard
| Challenge: | Existing methods that focus on learning a ranking across the whole candidate space are lacking user or task-specific training data. |
| Approach: | They propose an interactive ranking approach that actively selects pairs of candidates, from which the user selects the best. |
| Outcome: | The proposed approach outperforms existing methods in community question answering and extractive multidocument summarization and is an effective reward function for reinforcement learning. |
Analogy-Guided Evolutionary Pretraining of Binary Word Embeddings (2022.aacl-main)
Copied to clipboard
| Challenge: | Existing binary word embeddings are derived from pretrained real-valued embeddables through different simple transformations, which often break the semantic consistency and the “arithmetic” properties of the embedded words. |
| Approach: | They propose a genetic algorithm to learn binary word embeddings from scratch by preserving the semantic relationships between words and the arithmetic properties of the embeddables themselves. |
| Outcome: | Evaluating 16, 32, and 64-bit word embeddings on Mikolov’s word analogy task shows that 95% of the time, the best fit is ranked in the top 5 most similar words in terms of cosine similarity. |
MultiNERD: A Multilingual, Multi-Genre and Fine-Grained Dataset for Named Entity Recognition (and Disambiguation) (2022.findings-naacl)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a process of identifying named entities in unstructured texts and classifying them through specific semantic categories. |
| Approach: | They propose a method for automatically producing NER annotations and introduce a manually-annotated test set. |
| Outcome: | The proposed method covers 10 languages, 15 NER categories and 2 textual genres and a manually-annotated test set. |
ParCorFull: a Parallel Corpus Annotated with Full Coreference (L18-1)
Copied to clipboard
| Challenge: | Recent research in multilingual coreference and automatic pronoun translation has led to important insights into the problem and some promising results. |
| Approach: | They propose a corpus annotated with full coreference chains that addresses a problem that machine translation and other multilingual natural language processing (NLP) technologies face: translation of coreference across languages. |
| Outcome: | The proposed corpus contains parallel texts for the language pair English-German, two major European languages. |
Improving Pretraining Techniques for Code-Switched NLP (2023.acl-long)
Copied to clipboard
| Challenge: | Multilingual pretraining models for code-switched inputs are a key component of NLP applications. |
| Approach: | They propose to use masked language modeling techniques to mask code-switched text that are cognizant of language boundaries prior to masking. |
| Outcome: | The proposed techniques improve performance on two downstream tasks, Question Answering (QA) and Sentiment Analysis (SA), compared to standard pretraining techniques. |
A Dynamic Self-Evolving Extraction System (2026.acl-demo)
Copied to clipboard
| Challenge: | High-quality information extractions often require domain-specific accuracy, up-to-date understanding of specialized taxonomies, and the ability to incorporate emerging jargon and rare outliers. |
| Approach: | They propose a Dynamic Self-Evolving Extraction and Curation Toolkit which continuously improves as it is used to extract structured information from raw text. |
| Outcome: | The proposed toolkit continuously improves as it is used in medical, legal, and HR domains. |
Mukayese: Turkish NLP Strikes Back (2022.findings-acl)
Copied to clipboard
| Challenge: | Having sufficient resources for language X lifts it from the under-resourced languages class, but not necessarily from the researched class. |
| Approach: | They propose a set of NLP benchmarks for the Turkish language that contains several NLP tasks. |
| Outcome: | The proposed benchmarks outperform previous work significantly in the Turkish language. |
Modeling Multi-mapping Relations for Precise Cross-lingual Entity Alignment (D19-1)
Copied to clipboard
| Challenge: | Entity alignment aims to find entities in different knowledge graphs (KGs) that refer to the same real-world object. |
| Approach: | They propose to use dot product-based functions to define dot products over embeddings to better capture semantics of 1-N, N-1 and N-N relations. |
| Outcome: | The proposed framework outperforms existing methods on multilingual datasets. |
Structured Self-Supervised Pretraining for Commonsense Knowledge Graph Completion (2021.tacl-1)
Copied to clipboard
| Challenge: | Existing approaches focus on generating concepts that have direct and obvious relationships with existing concepts and lack an ability to generate unobvious concepts. |
| Approach: | They propose a general graph-to-paths pretraining framework that leverages high-order structures in CKGs to capture high-level relationships between concepts. |
| Outcome: | The proposed framework can capture high-order relationships between concepts in four special cases: long path, path-to-path, router, and graph-node-path. |
A Neural Few-Shot Text Classification Reality Check (2021.eacl-main)
Copied to clipboard
| Challenge: | Modern few-shot text classification models struggle when the amount of annotated data is scarce. |
| Approach: | They compare neural few-shot classification models with NLP and computer vision models with transformers to test their performance. |
| Outcome: | The proposed models perform almost equally on ARSC dataset, but not on the intent detection task. |
Disentangling Codemixing in Chats: The NUS ABC Codemixed Corpus (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on code-mixing have not been able to model human interactions in context. |
| Approach: | They propose to use a general-purpose code-mixing corpus to model human interactions and relationships in context while maintaining ethical standards. |
| Outcome: | The proposed corpus includes over 355,641 messages spanning various code-mixing patterns, with a primary focus on English, Mandarin, and other languages. |
Risks and NLP Design: A Case Study on Procedural Document QA (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing language models that answer recipes better than humans can mitigate risks to users. |
| Approach: | They propose to specialize the analysis to more concrete applications and their plausible users. |
| Outcome: | The proposed model answers recipes as well or better than humans who answered the questions on the web. |
A Survey of Data Augmentation Approaches for NLP (2021.findings-acl)
Copied to clipboard
Steven Y. Feng, Varun Gangal, Jason Wei, Sarath Chandar, Soroush Vosoughi, Teruko Mitamura, Eduard Hovy
| Challenge: | Data augmentation is a field of research that has been underexplored due to the discrete nature of language data. |
| Approach: | They present a comprehensive survey of data augmentation for NLP by summarizing the literature in a structured manner. |
| Outcome: | The proposed methods are used for popular NLP applications and tasks and highlight current challenges and directions for future research. |
ParCorFull2.0: a Parallel Corpus Annotated with Full Coreference (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing corpus ParCorFull contains parallel texts for English-German, French and Portuguese . translation of coreference across languages is challenging for MT and other NLP applications . |
| Approach: | They describe a parallel corpus annotated with full coreference chains for multiple languages . they use the existing corpus ParCorFull to study translation of coreference across languages - a challenge for machine translation and NLP . |
| Outcome: | The proposed corpus addresses translation of coreference across languages, a problem still challenging for machine translation and other multilingual natural language processing applications. |
Financial Sentiment Analysis: An Investigation into Common Mistakes and Silver Bullets (2020.coling-main)
Copied to clipboard
| Challenge: | Recent dominance of machine learning-based natural language processing methods has overemphasized model accuracies rather than studying the reasons behind their errors. |
| Approach: | They investigate the error patterns of some widely acknowledged sentiment analysis methods in the finance domain. |
| Outcome: | The proposed models are based on the existing models and have important clues for improving them. |
CogCompNLP: Your Swiss Army Knife for NLP (L18-1)
Copied to clipboard
Daniel Khashabi, Mark Sammons, Ben Zhou, Tom Redman, Christos Christodoulopoulos, Vivek Srikumar, Nicholas Rizzolo, Lev Ratinov, Guanheng Luo, Quang Do, Chen-Tse Tsai, Subhro Roy, Stephen Mayhew, Zhili Feng, John Wieting, Xiaodong Yu, Yangqiu Song, Shashank Gupta, Shyam Upadhyay, Naveen Arivazhagan, Qiang Ning, Shaoshi Ling, Dan Roth
| Challenge: | a corpus-reader module supports popular corpora, feature extraction and annotation modules for semantic and syntactic tasks. |
| Approach: | They propose a library that provides modules to address different challenges . they provide a corpus-reader module that supports popular corpora in the NLP community . |
| Outcome: | The proposed library simplifies the process of design and development of NLP applications by providing modules to address different challenges. |
MTSI-BERT: A Session-aware Knowledge-based Conversational Agent (2020.lrec-1)
Copied to clipboard
| Challenge: | Several models have been published achieving promising results in all the major linguistic tasks. |
| Approach: | They propose to exploit a BERT-based model to handle multi-turn conversations . they propose to use PuffBot to monitor asthma patients . |
| Outcome: | The proposed model can handle multi-turn conversations, a type of conversations that differs from single-turn by the presence of multiple related interactions. |
Code-Switching Patterns Can Be an Effective Route to Improve Performance of Downstream NLP Applications: A Case Study of Humour, Sarcasm and Hate Speech Detection (2020.acl-main)
Copied to clipboard
| Challenge: | In this paper, we demonstrate how code-switching patterns can be utilised to improve various downstream NLP applications. |
| Approach: | They propose to use code-switching patterns to improve various downstream NLP applications. |
| Outcome: | The proposed features can improve humour, sarcasm and hate speech detection tasks. |
Low-resource Entity Set Expansion: A Comprehensive Study on User-generated Text (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing benchmarks for entity set expansion (ESE) are limited to well-formed text and well-defined concepts. |
| Approach: | They propose to use user-generated text to assess the generalizability of ESE methods by identifying phenomena such as non-named entities, multifaceted entities and vague concepts. |
| Outcome: | The proposed methods are based on user-generated text to assess their generalizability and performance. |
A Comprehensive Survey of Sentence Representations: From the BERT Epoch to the CHATGPT Era and Beyond (2024.eacl-long)
Copied to clipboard
Abhinav Ramesh Kashyap, Thanh-Tung Nguyen, Viktor Schlegel, Stefan Winkler, See-Kiong Ng, Soujanya Poria
| Challenge: | Sentence representations are a critical component in NLP applications such as retrieval, question answering, and text classification. |
| Approach: | They present a systematic review of the literature on sentence representations focusing mostly on deep learning models. |
| Outcome: | The proposed methods highlight the key contributions and challenges in this area and suggest potential avenues for improving the quality and efficiency of sentence representations. |
Self-Adapted Utterance Selection for Suicidal Ideation Detection in Lifeline Conversations (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for identifying suicidal ideation in phone conversations are difficult to use because of their long duration and noisy nature. |
| Approach: | They propose a self-adaptive approach that identifies the most critical utterances that the NLP model can more easily distinguish. |
| Outcome: | The proposed approach outperforms the baseline models in overall performance with an F score of 66.01% and significantly higher F-score in detecting the most dangerous cases. |
Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution (2020.coling-main)
Copied to clipboard
| Challenge: | Lexical substitution is a powerful technology used in various NLP applications . it generates plausible words that can replace a given word in a textual context . |
| Approach: | They propose to use a large-scale comparative study to compare lexical substitution methods . they compare existing and new methods using word sense induction datasets . |
| Outcome: | The proposed methods improve competitive results by incorporating information about the target word into the models. |
Paraphrase to Explicate: Revealing Implicit Noun-Compound Relations (P18-1)
Copied to clipboard
| Challenge: | Existing methods for paraphrasing nouncompounds lack the ability to generalize and have a hard time interpreting infrequent or new noun-compound. |
| Approach: | They propose a neural model that generalizes better by representing paraphrases in a continuous space, generalizing for both unseen noun-compounds and rare paraphrase. |
| Outcome: | The proposed model generalizes better by representing paraphrases in a continuous space, generalizing for unseen noun-compounds and rare paraphrase. |
Multi-Task Pre-Finetuning of Lightweight Transformer Encoders for Text Classification and NER (2025.emnlp-industry)
Copied to clipboard
| Challenge: | nave multitask pre-finetuning introduces conflicting optimization signals that degrade overall performance. |
| Approach: | They propose a framework that enables a single shared encoder backbone with modular adapters. |
| Outcome: | The proposed framework achieves comparable performance to individual pre-finetuning while meeting practical deployment constraint. |
LoRA Meets Dropout under a Unified Framework (2024.findings-acl)
Copied to clipboard
| Challenge: | Parameter-efficientfinetuning (PEFT) has gained popularity as a lightweight approach for model customization. |
| Approach: | They propose a parameter-efficient dropout method that is overfitting-prone and parameter-freezed. |
| Outcome: | The proposed method is superior to existing methods and compares with transformer-specific methods. |
Factuality Assessment as Modal Dependency Parsing (2021.acl-long)
Copied to clipboard
| Challenge: | a critical step towards factuality assessment is to determine the factuality of events in text. |
| Approach: | They propose a modal dependency parsing task that assesses the factuality of events in text . they crowdsource a large-scale data set annotated with modal dependence structures . |
| Outcome: | The proposed model outperforms the pipeline model in factuality assessment . the proposed model is based on a crowdsourced dataset . |
Topic Taxonomy Expansion via Hierarchy-Aware Topic Phrase Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for topic taxonomies focus on frequent terms and local topic-subtopic relations, which leads to limited topic term coverage. |
| Approach: | They propose a framework for topic taxonomy expansion that directly generates topic-related terms belonging to new topics. |
| Outcome: | The proposed framework outperforms baseline methods on two real-world text corpora. |
Modeling Noisiness to Recognize Named Entities using Multitask Neural Networks on Social Media (N18-1)
Copied to clipboard
| Challenge: | Current approaches to Named Entity Recognition (NER) are effective in formal text, but they fail on informal text, where improper grammatical structures, spelling inconsistencies, and slang vocabulary prevail. |
| Approach: | They propose a multitask end-to-end bidirectional long short-term memory (BLSTM)-Conditional Random Field (CRF) network with two CRF classifiers and a feature extractor that transfers learning to a CRF for prediction. |
| Outcome: | The proposed models outperform the current state-of-the-art on the Workshop on Noisy User-generated Text 2017 dataset by 2.45% and 3.69%, establishing a more suitable approach for social media environments. |
Making Long-Context Language Models Better Multi-Hop Reasoners (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in long-context modeling have enhanced language models for complex tasks, but they struggle with multi-hop reasoning and noisy contexts. |
| Approach: | They propose an approach that prompts LMs to supply attributions for each assertion during reasoning. |
| Outcome: | The proposed model achieves competitive performance on multi-hop reasoning benchmarks, closely paralleling proprietary LMs such as ChatGPT and Claude-instant. |
Can Edge Probing Tests Reveal Linguistic Knowledge in QA Models? (2022.coling-1)
Copied to clipboard
| Challenge: | grammatical knowledge is encoded in large pre-trained language models (LMs) this is done through supervised classification tasks to predict the grammamatical properties of a span using only the token representations coming from the LM encoder. |
| Approach: | They propose to use a supervised 'edge probing' task to detect grammatical knowledge in large pre-trained language models (LMs) this is done by encoding grammamatical properties using only token representations coming from the LM encoder. |
| Outcome: | The proposed model performs well when fine-tuned or in adversarial situations where the model is forced to learn wrong correlations. |
Span-based Named Entity Recognition by Generating and Compressing Information (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing work on Named Entity Recognition (NER) only used generative or information compression models to improve performance. |
| Approach: | They propose to combine two types of IB models into one system to enhance Named Entity Recognition (NER) they incorporate unsupervised generative components span reconstruction and synonym generation into a span-based NER system. |
| Outcome: | The proposed model focuses on learning span representation, which is applicable not only to span-based NER but also to other span-related tasks such as event coreference resolution and question answering. |
Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to generalize deep neural networks are datahungry and generalize poorly from small datasets. |
| Approach: | They propose an agreement score to evaluate routing processes at instance-level and an adaptive optimizer to enhance routing. |
| Outcome: | The proposed approach improves on two NLP tasks and in low-resource settings with few training instances. |
Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent studies show that the energy requirements of current NLP models are growing at a rapid, unsustainable pace. |
| Approach: | They investigate ways to measure energy usage and different hardware settings that can be tuned to reduce energy consumption for training and inference for language models. |
| Outcome: | The proposed techniques can reduce energy consumption for training and inference for language models. |
An Algerian Corpus and an Annotation Platform for Opinion and Emotion Analysis (2020.lrec-1)
Copied to clipboard
| Challenge: | Currently, there are more than 4 billion Internet users worldwide . the number of social media users in Algeria has tripled over a year . |
| Approach: | They propose a platform for crowdsourcing annotation of tweets at different levels of granularity. |
| Outcome: | The proposed platform can be used to create the largest Algerian dialect subjectivity lexicon of about 9,000 entries. |
Negative Sampling Techniques in Dense Retrieval: A Survey (2026.findings-eacl)
Copied to clipboard
| Challenge: | Information Retrieval (IR) is fundamental to many modern NLP applications. |
| Approach: | They propose a taxonomy that categorizes negative sampling techniques in dense IR . they analyze them with respect to trade-offs between effectiveness, computational cost, implementation difficulty . |
| Outcome: | The proposed taxonomy categorizes techniques using random, static/dynamically mined, and synthetic datasets. |
Email Classification Incorporating Social Networks and Thread Structure (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for document classification in social networks capture only semantics of texts . incorporating social network information in addition to textual information is effective . |
| Approach: | They propose to incorporate social network information into document classification tasks . they use email as a feature and model email thread structure . |
| Outcome: | The proposed method improves over a state-of-the-art baseline based on textual information . the proposed method is based in two corpora, one of which we train on . |
T-VEC: A Telecom-Specific Vectorization Model with Enhanced Semantic Understanding via Deep Triplet Loss Fine-Tuning (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Generic embedding models struggle to represent telecom-specific semantics . specialized terminology and ambiguous terms often limit their utility in retrieval and downstream tasks. |
| Approach: | They propose a domain-adapted embedding model fine-tuned from a gte-Qwen2-1.5B-instruct backbone. |
| Outcome: | The proposed model outperforms MPNet, BGE, Jina and E5 on a custom benchmark . it is open source and has a triplet loss objective . |
SphereRE: Distinguishing Lexical Relations with Hyperspherical Relation Embeddings (P19-1)
Copied to clipboard
| Challenge: | Lexical relations are relations between terms in lexicons. |
| Approach: | They propose a neural representation learning model to distinguish lexical relations among term pairs based on hyperspherical relation embeddings. |
| Outcome: | The proposed model outperforms state-of-the-art models on several benchmarks. |
WASA: A Web Application for Sequence Annotation (L18-1)
Copied to clipboard
| Challenge: | a major barrier to research on CS has been the lack of large multilingual, multi-genre CS-annotated corpora. |
| Approach: | They propose a web-based annotation system that manages large-scale CS data annotation. |
| Outcome: | The proposed system can manage large-scale multilingual code switching (CS) data annotation. |
Towards Understanding Gender-Seniority Compound Bias in Natural Language Generation (2022.lrec-1)
Copied to clipboard
Samhita Honnavalli, Aesha Parekh, Lily Ou, Sophie Groenwold, Sharon Levy, Vicente Ordonez, William Yang Wang
| Challenge: | Existing studies have not investigated how gender biases in natural language processing (NLP) are compounded with other societal biase. |
| Approach: | They propose a framework for probing compound bias by examining seniority in pre-trained neural generation models. |
| Outcome: | The proposed framework amplifies bias by considering women as junior and men as senior more often than ground truth in both domains. |
FinMTEB: Finance Massive Text Embedding Benchmark (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing text embedding benchmarks for financial domains are inadequately addressing the nuanced requirements of specialized domains like finance. |
| Approach: | They propose a finance-adapted embedding model that outperforms general-purpose models . they also introduce a new model, Fin-E5, which is also open-sourced . |
| Outcome: | The proposed framework outperforms general-purpose models on financial embedding tasks. |
Building a Corpus for Personality-dependent Natural Language Understanding and Generation (L18-1)
Copied to clipboard
| Challenge: | The computational treatment of human personality is central to the development of NLP applications. |
| Approach: | They propose to use the b5 corpus to generate controlled and free (non-topic specific) texts . preliminary results of personality recognition from text are presented . |
| Outcome: | The proposed corpus is the largest resource of this kind to be made available for research purposes in the Brazilian Portuguese language. |
S2abEL: A Dataset for Entity Linking from Scientific Tables (2023.emnlp-main)
Copied to clipboard
| Challenge: | Entity linking (EL) is a longstanding problem in natural language processing and information extraction. |
| Approach: | They propose a neural baseline method for EL on scientific tables containing many out-of-knowledge-base mentions and a method that significantly outperforms a generic table EL method. |
| Outcome: | The proposed method significantly outperforms state-of-the-art generic table EL method on scientific tables with many out-of knowledge-base mentions. |
Calibrating Structured Output Predictors for Natural Language Processing (2020.acl-main)
Copied to clipboard
| Challenge: | Several modern machine-learning based NLP systems can provide a confidence score with their output predictions. |
| Approach: | They propose a general calibration scheme for output entities of interest in NLP applications that can be used to calibrate confidence scores. |
| Outcome: | The proposed calibration scheme outperforms current calibration techniques for Named Entity Recognition, Part-of-speech tagging and Question Answering systems. |
MirasText: An Automatically Generated Text Corpus for Persian (L18-1)
Copied to clipboard
Behnam Sabeti, Hossein Abedi Firouzjaee, Ali Janalizadeh Choobbasti, S.H.E. Mortazavi Najafabadi, Amir Vaheb
| Challenge: | Natural language processing is one of the most important fields of artificial intelligence. |
| Approach: | They propose to use MirasText to generate Persian text corpus from Persian websites . MiraSText has over 2.8 million documents and over 1.4 billion tokens . |
| Outcome: | The generated corpus has over 2.8 million documents and over 1.4 billion tokens . MirasText has over 800 billion token tokens and more than 300 thousand articles . |
WEC: Deriving a Large-scale Cross-document Event Coreference dataset from Wikipedia (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing datasets for cross-document event coreference resolution are limited and small . authors present a method for identifying clusters of text mentions that refer to the same event . |
| Approach: | They propose a method for generating a large-scale Wikipedia event coreference dataset . they use a generic approach that adapts state-of-the-art models to the cross-document setting . |
| Outcome: | The proposed method outperforms existing models and can be applied to other languages. |
The Arabic Parallel Gender Corpus 2.0: Extensions and Analyses (2022.lrec-1)
Copied to clipboard
| Challenge: | Gender bias in natural language processing (NLP) applications has been receiving increasing attention, largely due to the lack of datasets and resources. |
| Approach: | They propose a corpus for gender identification and rewriting in contexts involving one or two target users with independent grammatical gender preferences. |
| Outcome: | The proposed corpus expands on Habash et al.'s Arabic Parallel Gender Corpus (APGC) by adding second person targets and increasing the total number of sentences over 6.5 times, reaching over 590K words. |
Taxonomy Construction of Unseen Domains via Graph-based Cross-Domain Knowledge Transfer (2020.acl-main)
Copied to clipboard
| Challenge: | Existing taxonomies are either entirely absent or missing. |
| Approach: | They propose a GNN-based cross-domain transfer framework for the taxonomy construction task. |
| Outcome: | The proposed framework improves on benchmark datasets from science and environment domains. |
DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference (2020.acl-main)
Copied to clipboard
| Challenge: | Large-scale pre-trained language models such as BERT are notorious for being slow in both training and inference. |
| Approach: | They propose a method to accelerate BERT inference by inserting extra classification layers between each transformer layer of BERT. |
| Outcome: | The proposed method saves up to 40% inference time with minimal degradation in model quality. |
Variance-reduced First-order Meta-learning for Natural Language Processing Tasks (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing studies show that meta-learning can overfit to some specific adaptation when we have heterogeneous tasks. |
| Approach: | They propose to reduce the variance of the gradient estimator used in task adaptation by adding a new variance reduction term to the gradient estimation. |
| Outcome: | Experiments on few-shot text classification and multi-domain dialog state tracking show that the proposed method outperforms existing methods. |
DocOIE: A Document-level Context-Aware Dataset for OpenIE (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing solutions focus on extracting tuples at sentence level, but sentences exist as part of a document rather than standalone. |
| Approach: | They propose to annotate 800 sentences from 80 documents to form a DocOIE dataset . they propose to use document-level context to improve OpenIE performance . |
| Outcome: | The proposed OpenIE model improves performance by incorporating documentlevel context into the dataset. |
Why does PairDiff work? - A Mathematical Analysis of Bilinear Relational Compositional Operators for Analogy Detection (C18-1)
Copied to clipboard
| Challenge: | Existing methods for representing semantic relations between words are unclear . identifying relations between word and entity is important for NLP applications . |
| Approach: | They propose to compute the vector offset between word embeddings to represent relation between two words . they show that PairDiff is an uncorrelated bilinear operator that can be simplified to a linear form . |
| Outcome: | The proposed method is surprisingly accurate and can be used on multiple word embeddings. |
If you’ve seen some, you’ve seen them all: Identifying variants of multiword expressions (C18-1)
Copied to clipboard
| Challenge: | Multiword expressions (VMWEs) show idiosyncratic variability, which is challenging for NLP applications. |
| Approach: | They propose to use a model to identify variants of previously seen VMWEs by comparing VMWAs with morpho-syntactic variations. |
| Outcome: | The proposed approach outperforms a baseline by 4 percent points of F-measure on a French corpus. |
Can Word Sense Distribution Detect Semantic Changes of Words? (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to detect semantic variations of words are not accurate for time-sensitive predictions. |
| Approach: | They propose to use pretrained static sense embeddings to annotate a word's occurrence with a sense id to compare its distributions. |
| Outcome: | The proposed method compares word sense distributions across two corpora to predict meaning change . the results show that pretrained LLMs can detect changes in words over time . |
Causal-Debias: Unifying Debiasing in Pretrained Language Models and Fine-tuning via Causal Invariant Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to remove unwanted stereotypical associations from pretrained language models (PLMs) are often focused on removing unwanted stereotypes from PLMs. |
| Approach: | They propose a framework to remove unwanted stereotypical associations in pretrained language models . they propose bias-relevant factors are causal, while labelrelevant factors causal . |
| Outcome: | The proposed framework reduces stereotypical associations after PLMs are fine-tuned . the proposed framework mitigates bias from a causal invariant perspective . |
DAM: Dynamic Attention Mask for Long-Context Large Language Model Inference Acceleration (2025.findings-acl)
Copied to clipboard
| Challenge: | Long-context understanding is crucial for many NLP applications, but transformers struggle with efficiency due to quadratic complexity of self-attention. |
| Approach: | They propose a dynamic sparse attention mechanism that assigns adaptive masks at the attention-map level, preserving heterogeneous attention patterns. |
| Outcome: | The proposed method achieves high alignment with full-attention models while reducing memory and compute overhead. |
IndiSocialFT: Multilingual Word Representation for Indian languages in code-mixed environment (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on word embeddings for Indian languages focus on monolingual corpora with limited reach to social media setups. |
| Approach: | They propose a generalized representation vector for diverse text characteristics . they use a FastText model to gather text from social media and well-formed sources . |
| Outcome: | The proposed representation vector surpasses baselines in most cases and languages, demonstrating suitability for various NLP applications. |
Self-Discriminative Learning for Unsupervised Document Embedding (N19-1)
Copied to clipboard
| Challenge: | Existing methods for document embedding learning do not consider inter-document relationships. |
| Approach: | They propose to exploit the inter-document information and directly model the relations of documents in embedding space with a discriminative network and a novel objective. |
| Outcome: | The proposed method has errors that are 5 to 13% lower than state-of-the-art models and is even more pronounced in scarce label setting. |
McPhraSy: Multi-Context Phrase Similarity and Clustering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for estimating phrase similarity use the phrase context only during training, instead relying on the phrase itself. |
| Approach: | They propose a novel algorithm that leverages multiple contexts during inference to estimate the similarity of phrases based on multiple context. |
| Outcome: | The proposed method outperforms existing models on two phrase similarity datasets by 13.3% and a new task that relies on phrase similarities in the product reviews domain. |
Gender Bias in Multilingual Embeddings and Cross-Lingual Transfer (2020.acl-main)
Copied to clipboard
| Challenge: | Multilingual word embeddings embed words from many languages into a single semantic space such that words with similar meanings are close to each other regardless of the language. |
| Approach: | They propose to use multilingual word embeddings to align embeddable words from multiple languages into a single semantic space so that words with similar meanings are close to each other regardless of the language. |
| Outcome: | The proposed model can be used to learn gender bias in multilingual representations and to improve transfer learning. |
Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees (2021.eacl-main)
Copied to clipboard
| Challenge: | Pre-trained language models like BERT achieve superior performances in various NLP tasks without explicit consideration of syntactic information. |
| Approach: | They propose a plug-and-play framework that incorporates syntax trees into pre-trained Transformers. |
| Outcome: | The proposed framework improves on pre-trained models on natural language understanding datasets and shows that it can be used to train pre-structured neural networks. |
NLP Analytics in Finance with DoRe: A French 250M Tokens Corpus of Corporate Annual Reports (2020.lrec-1)
Copied to clipboard
| Challenge: | Recent advances in neural computing and word embeddings for semantic processing open many new applications areas which had been left unaddressed due to inadequate language understanding capacity. |
| Approach: | They propose a French and dialectal French corpus for NLP analytics in finance, regulation and investment. |
| Outcome: | The proposed corpus is designed to be as modular as possible to allow for maximum reuse in different tasks pertaining to Economics, Finance and Investment. |
Developing the Bangla RST Discourse Treebank (L18-1)
Copied to clipboard
| Challenge: | a corpus in Bangla is annotated for coherence relations between text segments representing propositions . the corpus is a valuable resource for conducting discourse studies for Bangla . |
| Approach: | They propose to build a Bangla-annotated corpus which includes 266 Bangla texts . they use Rhetorical Structure Theory as the theoretical framework to develop the corpus . |
| Outcome: | The proposed corpus contains 266 Bangla texts annotated for coherence relations . the research could be used for discourse studies and for developing NLP applications . |
Surprisal Estimators for Human Reading Times Need Character Models (2021.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that character models can be applied to a structural parser-based processing model to calculate word generation probabilities. |
| Approach: | They propose to use a character model to calculate word generation probabilities from a structural parser-based processing model. |
| Outcome: | The proposed model performs better on self-paced reading, eye-tracking, and fMRI data than large-scale language models trained on much more data. |
MACRONYM: A Large-Scale Dataset for Multilingual and Multi-Domain Acronym Extraction (2022.coling-1)
Copied to clipboard
Amir Pouran Ben Veyseh, Nicole Meister, Seunghyun Yoon, Rajiv Jain, Franck Dernoncourt, Thien Huu Nguyen
| Challenge: | Acronym extraction is the task of identifying acronyms and their expanded forms in texts . existing AE methods for English are limited to specific languages and domains . |
| Approach: | They propose to annotate 27,200 sentences in 6 different languages and 2 new domains for AE. |
| Outcome: | The proposed dataset shows that AE in different languages and learning settings has unique challenges . |
WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods to train large pretrained language models require more computational resources and are expensive to train in other languages. |
| Approach: | They propose a method to transfer pretrained language models to new languages using subword-based tokenization and embeddings. |
| Outcome: | The proposed method outperforms existing methods on low-resource languages and makes training large models more accessible and less damaging to the environment. |
SLICE: Supersense-based Lightweight Interpretable Contextual Embeddings (2020.coling-main)
Copied to clipboard
| Challenge: | Contextualised embeddings are a key component of human languages but their opaqueness makes it difficult to interpret their behaviour. |
| Approach: | They propose a weakly supervised method to learn interpretable embeddings from raw corpora and seed words. |
| Outcome: | The proposed model can represent both a word and its context as embeddings into the same compact space, whose dimensions correspond to interpretable supersenses. |
Multi-Source Cross-Lingual Model Transfer: Learning What to Share (P19-1)
Copied to clipboard
| Challenge: | Cross-lingual transfer learning (CLTL) is a viable method for building NLP models for a low-resource target language . however, many languages lack the labeled training data necessary for training deep neural nets for varying NLP tasks. |
| Approach: | They propose a cross-lingual transfer learning method that leverages annotated data from other languages to build NLP models for a target language. |
| Outcome: | The proposed model achieves significant performance gains over prior art over multiple text classification and sequence tagging tasks including a large-scale industry dataset. |
Clarify When Necessary: Resolving Ambiguity Through Interaction with LMs (2025.findings-naacl)
Copied to clipboard
| Challenge: | Ambiguity is embedded throughout natural language, and even simple utterances can have multiple interpretations when read in isolation. |
| Approach: | They propose a task-agnostic framework for evaluating a system’s ability to determine when to ask for clarification. |
| Outcome: | The proposed framework outperforms existing uncertainty estimation approaches at identifying predictions that will benefit from clarification. |
Mixture Content Selection for Diverse Sequence Generation (D19-1)
Copied to clipboard
| Challenge: | Generating diverse sequences exhibit semantically one-to-many relationships between source and target sequences. |
| Approach: | They propose to separate diversification from generation using a general plug-and-play module that wraps around and guides an existing encoder-decoder model. |
| Outcome: | The proposed method shows that diversification and generation are separate steps in the same model and that the model is robust. |
Incorporating Syntactic and Semantic Information in Word Embeddings using Graph Convolutional Networks (P19-1)
Copied to clipboard
Shikhar Vashishth, Manik Bhandari, Prateek Yadav, Piyush Rai, Chiranjib Bhattacharyya, Partha Talukdar
| Challenge: | Existing word embedding methods utilize sequential context of a word to learn its embeddment, but such methods result in an explosion of the vocabulary size. |
| Approach: | They propose a flexible Graph Convolution based method for learning word embeddings that utilizes the dependency context of a word without increasing the vocabulary size. |
| Outcome: | The proposed model outperforms existing methods on intrinsic and extrinsic tasks and provides an advantage when used with ELMo. |
Towards Modern Topic Models: A Survey of Taxonomies and Paradigm Shifts from Algorithm-Centric to LLM-Centered Topic Analysis (2026.findings-acl)
Copied to clipboard
| Challenge: | Topic modeling (TM) is a classic unsupervised learning task in the field of natural language processing. |
| Approach: | They propose a new taxonomy that emphasizes the role of LLMs and the design of end-to-end workflows. |
| Outcome: | The proposed taxonomy emphasizes the role of LLMs and the design of end-to-end workflows. |
A Diachronic Perspective on User Trust in AI under Uncertainty (2023.emnlp-main)
Copied to clipboard
| Challenge: | Modern NLP systems are rarely calibrated and are often confidently incorrect about their predictions, which violates users’ mental model and erodes their trust. |
| Approach: | They propose to use a mental model to bet on the correctness of an NLP system and to study how trust is rebuilt as a function of time after these events. |
| Outcome: | The proposed model shows that even a few highly inaccurate confidence estimation instances damage users’ trust in the system and performance, which does not easily recover over time. |
Comparison of Diverse Decoding Methods from Conditional Language Models (P19-1)
Copied to clipboard
| Challenge: | Conditional language models can generate a diverse set of outputs, but for open-ended tasks, beam search is ill-suited to generating a set of diverse sequences. |
| Approach: | They propose a method where we over-sample candidates and use clustering to remove similar sequences to achieve high diversity without sacrificing quality. |
| Outcome: | The proposed method over-samples candidates and removes similar sequences to achieve high diversity without sacrificing quality. |
Harnessing Pre-Trained Neural Networks with Rules for Formality Style Transfer (D19-1)
Copied to clipboard
| Challenge: | Existing studies normalize informal sentences with rules, but they introduce noise if we use them in a naive way. |
| Approach: | They propose to harness rules into a state-of-the-art neural network that is typically pretrained on massive corpora. |
| Outcome: | The proposed method can be used to generate a state-of-the-art on a small dataset. |
Building Context-aware Clause Representations for Situation Entity Type Classification (D18-1)
Copied to clipboard
| Challenge: | Existing models for categorizing clauses based on situation entity types do not provide accurate results. |
| Approach: | They propose to build context-aware clause representations for predicting situation entity types of clauses by modeling context influences and inter-dependencies of clause. |
| Outcome: | The proposed model achieves state-of-the-art performance on genre-rich dataset MASC+Wiki . |
Marked Attribute Bias in Natural Language Inference (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing tests for gender-biased word embeddings do not address marked attribute bias . authors propose a new type of intrinsic bias measure for static word embeds . |
| Approach: | They propose a method to detect gender-biased word embeddings in a downstream NLP application . they propose 'debiasing' method to measure the marked attribute bias in embeddable word embeds . |
| Outcome: | The proposed method achieves best results on the marked attribute bias test set. |
Cross-Lingual Transfer Robustness to Lower-Resource Languages on Adversarial Datasets (2024.lrec-main)
Copied to clipboard
| Challenge: | Multilingual Language Models (MLLMs) exhibit robust cross-lingual transfer capabilities for downstream tasks such as Named Entity Recognition (NER) challenges persist in MLLM implementations that are not cross-linguistically robust. |
| Approach: | They evaluate two well-known MLLMs on 13 pairs of languages with a geographic, genetic, or borrowing relationship. |
| Outcome: | The proposed models show that they can leverage information acquired in a source language and apply it to a target language. |
Introducing Lexical Masks: a New Representation of Lexical Entries for Better Evaluation and Exchange of Lexicons (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing standards for lexicon format and features are inadequate for evaluation and exchange . lexical masks are a powerful tool used to evaluate and exchange large lexiconic databases . |
| Approach: | They propose a tool to evaluate and exchange lexicon databases in many languages . they propose lexical masks which represent the expected internal structure of a lexico . |
| Outcome: | The proposed lexical masks can be used to evaluate and exchange lexicon databases in many languages. |
Cifu: a Frequency Lexicon of Hong Kong Cantonese (2020.lrec-1)
Copied to clipboard
| Challenge: | lexical database for Hong Kong Cantonese offers phonological and orthographic information, frequency measures, and lexically neighborhood information for lexicals in HKC. |
| Approach: | They introduce a lexical database for Hong Kong Cantonese that offers phonological and orthographic information, frequency measures, and lexically neighborhood information for lexicals in HKC. |
| Outcome: | The proposed lexical database for Hong Kong Cantonese offers phonological and orthographic information, frequency measures, and lexically neighborhood information. |
Negation Scope Refinement via Boundary Shift Loss (2023.findings-acl)
Copied to clipboard
| Challenge: | Negation detection is a complex linguistic phenomenon with long spans . existing methods tend to make wrong predictions around the scope boundaries . |
| Approach: | They propose a model which engages the Boundary Shift Loss to refine the predicted boundary. |
| Outcome: | The proposed model refines the predicted boundary on multiple datasets. |
Conditional Dichotomy Quantification via Geometric Embedding (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods that rely on semantic similarity fail to capture the nuanced oppositional dynamics essential for these applications. |
| Approach: | They propose a task that formalizes the measurement of conditional dichotomy by using a dichotomian framework. |
| Outcome: | The proposed framework provides carefully constructed datasets covering debate, defeasible inference, and causal reasoning scenarios. |
PMKI: an European Commission action for the interoperability, maintainability and sustainability of Language Resources (L18-1)
Copied to clipboard
| Challenge: | Public Multilingual Knowledge Management Infrastructure (PMKI) is a project launched by the European Commission to promote the digital single market in the EU. |
| Approach: | The paper presents the Public Multilingual Knowledge Management Infrastructure (PMKI) action launched by the European Commission to promote the Digital Single Market in the European Union. |
| Outcome: | The proposed public multilingual knowledge management infrastructure (PMKI) is a pilot project launched by the European Commission to promote the digital single market in the European Union. |
Data-Informed Global Sparseness in Attention Mechanisms for Deep Neural Networks (2024.lrec-main)
Copied to clipboard
| Challenge: | Attention pruning techniques have been developed to identify and exploit sparseness . previous work has taken pioneering steps to discover and explain the sparsity in attention patterns . |
| Approach: | They propose a framework that observes attention patterns in a fixed dataset and generates a global sparseness mask. |
| Outcome: | The proposed approach saves 90% of computations and maintains quality of results. |
Learning Event Graph Knowledge for Abductive Reasoning (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models for abductive reasoning based on formal logic lack commonsense knowledge and effective reasoning mechanism. |
| Approach: | They propose a narrative text-based abductive reasoning task NLI with a latent variable to capture commonsense knowledge from event graph for guiding the abductive reasoning task. |
| Outcome: | The proposed model outperforms baseline methods on the abductive reasoning task. |
Efficient Classification of Long Documents via State-Space Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing transformer-based models can only process long documents with limited computational resources due to their quadratic computation time and space. |
| Approach: | They propose to use state-space models for long document classification tasks instead of using sparse or hierarchical structures to solve this problem. |
| Outcome: | The proposed model performs comparable to self-attention models while being 36% more efficient. |
Incorporating Inner-word and Out-word Features for Mongolian Morphological Segmentation (2020.coling-main)
Copied to clipboard
| Challenge: | Mongolian morphological segmentation is a crucial preprocessing step in many Mongolian related NLP applications. |
| Approach: | They propose a neural network incorporating inner-word and out-word features for Mongolian morphological segmentation. |
| Outcome: | The proposed network is compared with baselines and evaluates its performance. |
Obtaining Better Static Word Embeddings Using Contextual Embedding Models (2021.acl-long)
Copied to clipboard
| Challenge: | Recent contextual word embeddings have prohibitively high computational cost in many use-cases and are hard to interpret. |
| Approach: | They propose a distillation method which is an extension of CBOW-based training and improves computational efficiency of NLP applications. |
| Outcome: | The proposed method outperforms existing models and existing models in terms of quality and performance. |
Revisiting Joint Modeling of Cross-document Entity and Event Coreference Resolution (P19-1)
Copied to clipboard
| Challenge: | Recognizing that various textual spans across multiple texts refer to the same entity or event is an important NLP task. |
| Approach: | They propose a neural architecture for cross-document coreference resolution by representing an event mention using its lexical span, surrounding context, and relation to other mentions via predicate-arguments structures. |
| Outcome: | The proposed model outperforms the state-of-the-art event coreference model on ECB+ while providing the first entity coreference results on this corpus. |
Angry Men, Sad Women: Large Language Models Reflect Gendered Stereotypes in Emotion Attribution (2024.acl-long)
Copied to clipboard
| Challenge: | Large language models reflect societal norms and biases, especially about gender. |
| Approach: | They propose to use large language models to examine gendered emotion attribution in five state-of-the-art LLMs to investigate whether emotions are genderes and whether they are influenced by societal stereotypes. |
| Outcome: | The proposed models exhibit gendered emotions, influenced by gender stereotypes, and the results are consistent with established research in psychology and gender studies. |
HOTTER: Hierarchical Optimal Topic Transport with Explanatory Context Representations (2021.findings-emnlp)
Copied to clipboard
Sabine Wehnert, Christian Scheel, Simona Szakács-Behling, Maret Nieländer, Patrick Mielke, Ernesto William De Luca
| Challenge: | Natural language processing (NLP) is often the backbone of today’s systems for user interactions, information retrieval and others. |
| Approach: | They propose an extension to a specific emerging hybrid document distance metric which combines topic models and word embeddings. |
| Outcome: | The proposed method is competitive on public datasets and the language model BERT is used for a document categorization task. |
Defense against Synonym Substitution-based Adversarial Attacks via Dirichlet Neighborhood Ensemble (2021.acl-long)
Copied to clipboard
| Challenge: | Recent studies show vulnerability of deep neural networks to adversarial examples that intentionally fool the networks. |
| Approach: | They propose a method for training a robust model to defense synonym substitution-based attacks by sampling embedding vectors for each word in an input sentence and augmenting them with the training data. |
| Outcome: | The proposed method outperforms other proposed defense methods by a significant margin across different network architectures and multiple data sets. |
Unsupervised Semantic Variation Prediction using the Distribution of Sibling Embeddings (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work on semantic variation prediction has focused on comparing an averaged contextualised representation of a word . however, some of the previously associated meanings of . a target word can become obsolete over time, while novel usages of existing words are observed. |
| Approach: | They propose a method that uses the entire cohort of contextualised embeddings of a target word to detect the semantic variation of words. |
| Outcome: | The proposed method outperforms existing methods on a SemEval-2020 benchmark dataset and is comparable to the state-of-the-art. |
ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Paraphrase generation is a long-standing task in natural language processing (NLP). |
| Approach: | They propose to generate large-scale syntactically diverse paraphrase datasets by abstract meaning representation back-translation. |
| Outcome: | The proposed dataset is syntactically more diverse than existing datasets while maintaining good semantic similarity. |
IceBATS: An Icelandic Adaptation of the Bigger Analogy Test Set (2022.lrec-1)
Copied to clipboard
| Challenge: | a new test set that measures word embeddings' ability to recognize linguistic regularities is presented in a paper in elijsson, iran . the test sets are a good quality estimator for extrinsic evaluation of word embedded models . |
| Approach: | They propose a test set that measures language models' ability to recognize linguistic regularities in a balanced way. |
| Outcome: | The proposed set is apt at measuring the capabilities of word embedding models. |
A Semantic Distance Metric Learning approach for Lexical Semantic Change Detection (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing Word-in-Context (WiC) datasets are used to detect temporal semantic changes of words. |
| Approach: | They propose a supervised two-staged SCD method that uses existing Word-in-Context (WiC) datasets to predict temporal semantic changes of words. |
| Outcome: | The proposed method achieves strong performance in multiple languages and significant improvements on WiC benchmarks. |
Knowledge Association with Hyperbolic Knowledge Graph Embeddings (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for knowledge graphs (KGs) depend on high embedding dimensions and hierarchical structures to achieve expressiveness. |
| Approach: | They propose a hyperbolic relational graph neural network for KG embedding and capture knowledge associations with a high-dimensional transformation. |
| Outcome: | Experiments on entity alignment and type inference show the proposed method is effective and efficient. |
Give me your Intentions, I’ll Predict our Actions: A Two-level Classification of Speech Acts for Crisis Management in Social Media (2022.lrec-1)
Copied to clipboard
| Challenge: | Using social networks, social media is a vital tool for emergency management and social media has been used to generate valuable information in crisis situations. |
| Approach: | They propose to measure for the first time the role of SA on urgency detection in tweets . they propose to use a two-layer annotation scheme to annotate tweets for both SA and urgency . |
| Outcome: | The proposed scheme combines two-layer annotation scheme and deep learning experiments to detect SA in a crisis corpus. |
A Warm Start and a Clean Crawled Corpus - A Recipe for Good Language Models (2022.lrec-1)
Copied to clipboard
Vésteinn Snæbjarnarson, Haukur Barri Símonarson, Pétur Orri Ragnarsson, Svanhvít Lilja Ingólfsdóttir, Haukur Jónsson, Vilhjalmur Thorsteinsson, Hafsteinn Einarsson
| Challenge: | Pre-trained neural language models have shown impressive results when adapted for a variety of classification and text generation tasks. |
| Approach: | They propose to use Icelandic's Icelandic Common Crawl Corpus to train language models that achieve state-of-the-art performance in downstream tasks. |
| Outcome: | The proposed models achieve state-of-the-art in a variety of downstream tasks including part-of speech tagging, named entity recognition and constituency parsing. |
GD-COMET: A Geo-Diverse Commonsense Inference Model (2023.emnlp-main)
Copied to clipboard
| Challenge: | GD-COMET is a geo-diverse version of the COMET commonsense inference model . it captures and generates culturally nuanced commonsensense knowledge . lack of cultural awareness may lead to models perpetuating stereotypes and reinforcing societal inequalities for users from non-Western countries. |
| Approach: | They propose a geo-diverse version of COMET commonsense reasoning model that generates inferences pertaining to a broad range of cultures. |
| Outcome: | The proposed model generates inferences pertaining to a broad range of cultures and is culturally nuanced. |
BiSECT: Learning to Split and Rephrase Sentences with Bitexts (2021.emnlp-main)
Copied to clipboard
| Challenge: | Several past efforts have created Split and Rephrase training sets, which consist of long, complex input sentences paired with multiple shorter sentences that preserve the meaning of the input sentence. |
| Approach: | They propose a new dataset and a model for this task by extracting 1-2 sentence alignments from bilingual parallel corpora and using machine translation to convert both sides of the corpus into the same language. |
| Outcome: | The proposed model can perform a wider variety of split operations and improve upon previous state-of-the-art approaches in automatic and human evaluations. |
Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions (2024.lrec-main)
Copied to clipboard
| Challenge: | Emotion analysis (EA) is a rapidly growing field in natural language processing . there is no consensus on scope, direction, or methods for EA . |
| Approach: | They review 154 relevant NLP papers on emotion analysis from the last decade . they ask: how are EA tasks defined in NLP? what are the most prominent emotion frameworks and which emotions are modeled? |
| Outcome: | The authors examine 154 relevant NLP papers on emotion analysis from the last decade . they find that there is no consensus on scope, direction, or methods . |
PreQuant: A Task-agnostic Quantization Approach for Pre-trained Language Models (2023.findings-acl)
Copied to clipboard
Zhuocheng Gong, Jiahao Liu, Qifan Wang, Yang Yang, Jingang Wang, Wei Wu, Yunsen Xian, Dongyan Zhao, Rui Yan
| Challenge: | Quantization is a viable solution for pre-trained language models, but most existing methods are task-specific and require customized training and quantization with a large number of trainable parameters. |
| Approach: | They propose a "quantize before fine-tuning" framework that allows for quantization with a large number of trainable parameters on each individual task. |
| Outcome: | The proposed framework is compatible with quantization-aware training and post-training quantization and corrects quantization errors. |
Scalable and Domain-General Abstractive Proposition Segmentation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Several recent studies have demonstrated the utility of proposition segmentation for downstream tasks. |
| Approach: | They propose a scalable, yet accurate, proposition segmentation model that can be supervised by LLMs. |
| Outcome: | The proposed model improves on training on annotated datasets and shows that it is easy to use. |
Enhanced Coherence-Aware Network with Hierarchical Disentanglement for Aspect-Category Sentiment Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | Aspect-category-based sentiment analysis (ACSA) is a popular approach for identifying aspect categories and predicting their sentiments. |
| Approach: | They propose an enhanced coherence-aware network with hierarchical disentanglement (ECAN) to capture contexts across the whole review and to help the implicit aspect and sentiment identification. |
| Outcome: | The proposed network decouples multiple aspects and sentiment features and achieves state-of-the-art (SOTA) performance. |
Swap and Predict – Predicting the Semantic Changes in Words across Corpora by Context Swapping (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Detecting semantic changes of words is an important task for various NLP applications that must make time-sensitive predictions. |
| Approach: | They propose a method that randomly swaps contexts between two different corpora to detect whether a given word changes its meaning . they then use a pretrained masked language model to generate contextualised word embeddings of w, which are then used to predict the semantic changes of words in four languages . |
| Outcome: | The proposed method achieves significant performance improvements compared to baselines for the English semantic change prediction task. |
Detecting Multiword Expression Type Helps Lexical Complexity Assessment (2020.lrec-1)
Copied to clipboard
| Challenge: | Multiword expressions (MWEs) represent lexemes that should be treated as single lexical units due to their idiosyncratic nature. |
| Approach: | They re-annotate a complex word identification shared task 2018 dataset . they find that a lexical complexity assessment system benefits from the information . |
| Outcome: | The proposed dataset provides valuable information for the text simplification community. |
KG-TRICK: Unifying Textual and Relational Information Completion of Knowledge for Multilingual Knowledge Graphs (2025.coling-main)
Copied to clipboard
Zelin Zhou, Simone Conia, Daniel Lee, Min Li, Shenglei Huang, Umar Farooq Minhas, Saloni Potdar, Henry Xiao, Yunyao Li
| Challenge: | Existing studies have shown that combining information from KGs in different languages aids knowledge Graph Completion and Knowledge Graph Enhancement. |
| Approach: | They propose a sequence-to-sequence framework that unifies tasks of textual and relational information completion for multilingual knowledge graphs. |
| Outcome: | The proposed framework unifies tasks of KGC and KGE into a single framework. |
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer (2020.emnlp-main)
Copied to clipboard
| Challenge: | Current deep pretrained models lack capacity to represent all languages . limited capacity is an issue even for high-resource languages where models are not included in training data at all. |
| Approach: | They propose an adapter-based framework that enables high portability and parameter-efficient transfer to arbitrary tasks and languages by learning modular language and task representations. |
| Outcome: | The proposed framework outperforms state-of-the-art models on cross-lingual transfer across languages and typologically diverse models. |
Vector-Vector-Matrix Architecture: A Novel Hardware-Aware Framework for Low-Latency Inference in NLP Applications (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to improve accuracy of neural networks are slow due to computational complexity. |
| Approach: | They propose a vector-vector-matrix architecture which greatly reduces latency at inference time for NLP applications by a factor of four. |
| Outcome: | The proposed framework reduces the latency of sequence-to-sequence and Transformer models used for NMT by a factor of four. |
Prague Dependency Treebank - Consolidated 1.0 (2020.lrec-1)
Copied to clipboard
Jan Hajič, Eduard Bejček, Jaroslava Hlavacova, Marie Mikulová, Milan Straka, Jan Štěpánek, Barbora Štěpánková
| Challenge: | Using the standard PDT scheme, the Prague Dependency Treebank-Consolidated 1.0 contains 4 different datasets of Czech, uniformly annotated using the standard scheme. |
| Approach: | They present a richly annotated and genre-diversified language resource, the Prague Dependency Treebank-Consolidated 1.0, which contains 4 different datasets of Czech, uniformly annnotated using the standard PDT scheme. |
| Outcome: | The Prague Dependency Treebank-Consolidated 1.0 contains 4 datasets of Czech, uniformly annotated using the standard PDT scheme. |
Deconstructing word embedding algorithms (2020.emnlp-main)
Copied to clipboard
| Challenge: | Word embeddings are reliable feature representations of words used in many NLP tasks today. |
| Approach: | They propose to deconstruct Word2vec, GloVe and others into a common form . they propose to generalize several word embedding algorithms into . a low rank embedder framework is proposed to generalise the algorithms into one common form. |
| Outcome: | The proposed framework can be used to make word embeddings more performant. |
Enriching a Lexicon of Discourse Connectives with Corpus-based Data (L18-1)
Copied to clipboard
| Challenge: | Existing annotation efforts for multiple languages have focused on discourse connectives, but we have limited it to the class of connectives marking contrast and the additional relations such connectives might convey. |
| Approach: | They enrich a lexicon of italian COnnectives with real corpus data for connectives marking contrast relations in text. |
| Outcome: | The proposed resource is a valuable tool for linguistic analyses of discourse relations and the training of a classifier for NLP applications. |
Continual Training of Language Models for Few-Shot Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on applying large language models (LMs) achieves impressive performance in many NLP applications. |
| Approach: | They propose to continuously post-train an LM with unlabeled domains to expand its knowledge without forgetting previous skills. |
| Outcome: | The proposed system improves few-shot end-task learning in these domains. |
Improving Low Compute Language Modeling with In-Domain Embedding Initialisation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to train language models on in-domain data are limited. |
| Approach: | They propose to initialise and freeze in-domain embeddings to provide a useful representation of rare words in English . they find that the standard configuration is not optimal when rare words are present . |
| Outcome: | The proposed approach improves language modeling by providing a useful representation of rare words in English. |
LaoPLM: Pre-trained Language Models for Lao (2022.lrec-1)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) can capture different levels of concepts in context . previous work on Lao has been hampered by the lack of annotated datasets . |
| Approach: | They construct a text classification dataset to alleviate the resource-scarce situation of Lao . they evaluate them on two downstream tasks: part-of-speech tagging and text classification . |
| Outcome: | The proposed model can capture different levels of concepts in context and generate universal language representations. |
Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models (2024.lrec-main)
Copied to clipboard
Oana Ignat, Zhijing Jin, Artem Abzaliev, Laura Biester, Santiago Castro, Naihao Deng, Xinyi Gao, Aylin Ece Gunal, Jacky He, Ashkan Kazemi, Muhammad Khalifa, Namho Koh, Andrew Lee, Siyang Liu, Do June Min, Shinka Mori, Joan C. Nwatu, Veronica Perez-Rosas, Siqi Shen, Zekun Wang, Winston Wu, Rada Mihalcea
| Challenge: | Recent advances in large language models have led to misleading public discourse that “it’s all been solved.” |
| Approach: | They identify 14 research areas encompassing 45 research directions that require new research and are not directly solvable by LLMs. |
| Outcome: | The research areas identified are 45 research directions that require new research and are not directly solvable by LLMs. |
Recognizing Semantic Relations by Combining Transformers and Fully Connected Models (2020.lrec-1)
Copied to clipboard
| Challenge: | Current approaches to recognizing semantic relations between words are limited and require a word-path model. |
| Approach: | They propose a distributional approach that is based on an attention-based transformer and a word path model that combines useful properties of a convolutional network with a fully connected language model. |
| Outcome: | The proposed model outperforms the state-of-the-art in terms of performance and data sources. |
Boosting Event Extraction with Denoised Structure-to-Text Augmentation (2023.findings-acl)
Copied to clipboard
Bo Wang, Heyan Huang, Xiaochi Wei, Ge Shi, Xiao Liu, Chong Feng, Tong Zhou, Shuaiqiang Wang, Dawei Yin
| Challenge: | Existing methods for event extraction neglect grammatical incorrectness, structure misalignment, and semantic drifting . et al., 2004; Ahn, 2006) show that the proposed method generates more diverse text representations for event extracting compared with the state-of-the-art. |
| Approach: | They propose a framework for event extraction that generates additional training data and iteratively selects the effective subset from the generated training data. |
| Outcome: | The proposed method generates more diverse representations of training data and achieves comparable results with the state-of-the-art. |
Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to evaluate ChatGPT's causal reasoning abilities are based on pre-trained language models, but they rely on supervised training. |
| Approach: | They conduct the first comprehensive evaluation of ChatGPT’s causal reasoning capabilities using four state-of-the-art (STA) simulations. |
| Outcome: | The proposed model is not a good causal reasoner, but a great causal interpreter. |
Tackling Irony Detection using Ensemble Classifiers (2022.lrec-1)
Copied to clipboard
| Challenge: | Automated approaches to irony detection still fall short of what one would consider desirable performance. |
| Approach: | They propose to use transformer-based approaches to automate irony detection in social media . they propose to augmentation training data to address the binary and fine-grained problem . |
| Outcome: | The proposed methods improve performance over baselines and are not decisive for good results. |
What is the Real Intention behind this Question? Dataset Collection and Intention Classification (2023.acl-long)
Copied to clipboard
| Challenge: | Using the Wikipedia discussions, we identified positive/neutral and negative intentions in questions . questions can also reflect implicit offenses such as highlighting one’s lack of knowledge or bolstering an alleged superior knowledge, which can lead to conflict in conversations. |
| Approach: | They propose to use a dataset to identify questions with positive/neutral and negative intentions and the underlying intention categories within each group to highlight tacit and apparent intents. |
| Outcome: | The proposed method highlights tacit and apparent intents and uses Transformers augmented by TF-IDF-based features to classify the main intention categories. |
Consonant is all you need: a compact representation of English text for efficient NLP (2023.findings-emnlp)
Copied to clipboard
| Challenge: | In natural language processing, the representation of text plays a crucial role in various tasks such as language modeling, sentiment analysis, and machine translation. |
| Approach: | They propose a method to represent English text with only consonants that is more discriminative than vowels and a technique to retrieve vowel information from it. |
| Outcome: | The proposed representation significantly reduces the overall memory and compute footprint required for storing and processing textual data. |
One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP Tasks (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Morphologically rich languages are notoriously challenging to process for downstream NLP applications. |
| Approach: | They propose a pretrained model for NLP applications involving the morphologically rich language Sanskrit that outperforms previous models by a considerable margin. |
| Outcome: | The proposed model outperforms tokenized models on established Sanskrit word segmentation tasks and matches the current best lexicon-based model. |
A Systematic Investigation of Commonsense Knowledge in Large Language Models (2022.emnlp-main)
Copied to clipboard
Xiang Lorraine Li, Adhiguna Kuncoro, Jordan Hoffmann, Cyprien de Masson d’Autume, Phil Blunsom, Aida Nematzadeh
| Challenge: | Recent large language models (LMs) have shown impressive performance on many NLP tasks under the zero-shot and few-shot setup. |
| Approach: | They conduct a systematic and rigorous zero-shot and few-shot commonsense evaluation of large pre-trained language models to better understand their ability to capture commonsensical knowledge. |
| Outcome: | The proposed model can exploit surface cues and annotation artefacts without task-specific supervision and is insufficient to achieve human-level commonsense performance. |
Injecting Domain Knowledge in Language Models for Task-oriented Dialogue Systems (2022.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained language models lack domain-specific knowledge that does not naturally occur in pre-training data. |
| Approach: | They propose to inject domain-specific knowledge prior to fine-tuning on TOD tasks by using adapters that can be easily integrated with PLMs. |
| Outcome: | The proposed methods show that they can inject domain-specific knowledge prior to fine-tuning on TOD tasks. |
Fooling the Textual Fooler via Randomizing Latent Representations (2024.findings-acl)
Copied to clipboard
| Challenge: | Several adversarial attacks can compromise the model without accessing the model architecture or model parameters (i.e., a blackbox setting) Several studies have revealed that deep NLP models are vulnerable to adversarials that slightly perturb the input to cause the models to misbehave. |
| Approach: | They propose a lightweight and attack-agnostic defense that perplexes the process of generating an adversarial example in query-based black-box attacks. |
| Outcome: | The proposed defense is lightweight and attack-agnostic and does not necessitate additional computational overhead during training nor does it rely on assumptions about the potential adversarial perturbation set while having a negligible impact on the model’s accuracy. |
Improving Sentence Boundary Detection for Spoken Language Transcripts (2020.lrec-1)
Copied to clipboard
| Challenge: | Using data expansion and transfer learning, we find that data expansion does not always improve results. |
| Approach: | They propose to divide spoken language into sentence-like units using Topological Fields model . they also propose to use data from the same domain to test different ML architectures . |
| Outcome: | The proposed model improves the detection of boundary detection in spoken dialogues compared to a sequence tagging approach. |
Language Variety Identification with True Labels (2024.lrec-main)
Copied to clipboard
Marcos Zampieri, Kai North, Tommi Jauhiainen, Mariano Felice, Neha Kumari, Nishant Nair, Yash Mahesh Bangera
| Challenge: | Language identification datasets are compiled with the assumption that the gold label of each instance is determined by where texts are retrieved from. |
| Approach: | They present a human-annotated multilingual dataset for language variety identification . they use a model to train multiple models to discriminate between different languages . |
| Outcome: | The proposed dataset provides a reliable benchmark toward robust and fairer language variety identification systems. |
FoodSafeSum: Enabling Natural Language Processing Applications for Food Safety Document Summarization and Analysis (2025.findings-emnlp)
Copied to clipboard
Juli Bakagianni, Korbinian Randl, Guido Rocchietti, Cosimo Rulli, Franco Maria Nardini, Salvatore Trani, Aron Henriksson, Anna Romanova, John Pavlopoulos
| Challenge: | a lack of structured datasets hinders natural language processing research . a new dataset of food safety documents and related metadata is presented . |
| Approach: | They present a dataset of human-written and Large Language Model (LLM)-generated food safety documents . they evaluate their utility on three NLP tasks directly reflecting food safety practices . |
| Outcome: | The proposed dataset performs comparably or better than human summaries on three NLP tasks . it also shows clustering of summary for event tracking and compliance monitoring . |
Multilingual Generation and Answering of Questions from Texts and Knowledge Graphs (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for QG-QA are limited to English, but can be used in other languages. |
| Approach: | They propose to bring multilinguality to multimodal QG-QA by using Brazilian Portuguese and Russian data. |
| Outcome: | The proposed approach outperforms a baseline on English and can handle both languages. |
BYOC: Personalized Few-Shot Classification with Co-Authored Class Descriptions (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to text classification require large annotated corpora to train or long context to fit many examples. |
| Approach: | They propose a method to few-shot text classification using an LLM. |
| Outcome: | The proposed approach yields high accuracy classifiers within 79% of the performance of models trained with larger datasets while using only 1% of their training sets. |
Semantic Compression for Word and Sentence Embeddings using Discrete Wavelet Transform (2024.findings-acl)
Copied to clipboard
| Challenge: | Discrete Wavelet Transforms (DWT) can be applied to NLP capturing a variety of linguistic and semantic properties. |
| Approach: | They propose to use Discrete Wavelet Transforms to analyze word and sentence embeddings . they show that DWT can reduce dimensionality of embeddables by 50-93% . |
| Outcome: | The proposed paradigm reduces embeddings' dimensionality by 50-93% while maintaining their quality. |
Substance over Style: Evaluating Proactive Conversational Coaching Agents (2025.acl-long)
Copied to clipboard
Vidya Srinivas, Xuhai Xu, Xin Liu, Kumar Ayush, Isaac Galatzer-Levy, Shwetak Patel, Daniel McDuff, Tim Althoff
| Challenge: | Recent NLP research has focused on single-turn tasks with well-defined objectives or evaluation criteria. |
| Approach: | They describe five multi-turn coaching agents that exhibit distinct conversational styles and evaluate them through a user study. |
| Outcome: | The authors compare user feedback with third-person evaluations from health experts and an LM to find that stylistic components in absence of core functionality are viewed negatively. |
Attributes as Textual Genes: Leveraging LLMs as Genetic Algorithm Simulators for Conditional Synthetic Data Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Genetic Prompt combines genetic algorithms with Large Language Models to augment synthetic data generation. |
| Approach: | They propose a framework that combines genetic algorithms with LLMs to augment synthetic data generation. |
| Outcome: | The proposed framework outperforms state-of-the-art models and shows robust performance across generator models. |
Inclusive Leadership in the Age of AI: A Dataset and Comparative Study of LLMs vs. Real-Life Leaders in Workplace Action Planning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new study compares LLMs and human leaders in workplace action planning tasks . the leader success bot guides real-life leaders in generating inclusive workplace action plans . |
| Approach: | They propose a leader success bot that guides leaders in generating inclusive workplace action plans. |
| Outcome: | The Leader Success Bot guides real-life leaders in generating inclusive workplace action plans. |
SYNFAC-EDIT: Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarization (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) struggle with factual inaccuracies, a critical issue in clinical NLP applications where errors could lead to serious consequences. |
| Approach: | They propose a pipeline that leverages >100B parameter GPT variants to act as synthetic experts to generate edit feedback without additional human annotations. |
| Outcome: | The proposed pipeline aims to improve the quality of clinical note summarizations by generating edit feedback without human annotations. |
Automatic sentence segmentation of clinical record narratives in real-world data (2024.emnlp-main)
Copied to clipboard
| Challenge: | Sentence segmentation is a linguistic task used as a pre-processing step in many NLP applications. |
| Approach: | They propose a sequence labeling classifier that predicts sentence spans using a dynamic sliding window based on the prediction of each input sequence. |
| Outcome: | The proposed method outperforms state-of-the-art systems on clinical notes and on five other datasets to assess its generalizability and performance. |
Qabas: An Open-Source Arabic Lexicographic Database (2024.lrec-main)
Copied to clipboard
| Challenge: | Qabas is an open-source Arabic lexicon designed for NLP applications. |
| Approach: | They propose to link lemmas from 110 lexicons into a morphologically annotated Arabic lexicoma. |
| Outcome: | Qabas lexical entries (lemmas) are assembled by linking lemmas from 110 lexicons. |
Specifying Genericity through Inclusiveness and Abstractness Continuous Scales (2024.lrec-main)
Copied to clipboard
| Challenge: | Using a pilot study, we created a small but crucial annotated dataset of 324 sentences, demonstrating the framework’s effectiveness in capturing nuanced aspects of genericity. |
| Approach: | They propose a framework for fine-grained modeling of noun phrases' genericity in natural language using a small but crucial annotated dataset of 324 sentences. |
| Outcome: | The proposed framework can be used to model genericity of noun phrases in natural language and can be easily compared with existing binary annotations. |
Leveraging Text-to-Text Transformers as Classifier Chain for Few-Shot Multi-Label Classification (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multilabel text classification (MLTC) is an essential task in NLP applications. |
| Approach: | They propose a distillation-based T5 generalist model for zero-shot MLTC and few-shot fine-tuning. |
| Outcome: | The proposed model outperforms baselines of similar size on three few-shot tasks. |
ZoomRAG: Hierarchical Random-walk Zooming across Multi-scale Information Graphs for Fast and Accurate RAG (2026.findings-acl)
Copied to clipboard
Xianming Hu, Jingyang Chen, Bin Tang, Yihe Liu, Yihong Huang, Hongbo Zhao, Nuoyi Chen, Jie Zhang, Ping Li, Kai Zhang
| Challenge: | retrieval-augmented generation (RAG) is a powerful tool for NLP applications . but it is challenging to encode large knowledge bases as compact offline structures . |
| Approach: | They propose a coarse-to-fine hierarchical graph inference method that uses random walks to retrieve information from a corpus of documents. |
| Outcome: | The proposed method reduces offline indexing costs and accelerates retrieval. |